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1. ABSTRACT 

The UCI/GWC Project (University of California, Irvine, and Golden West College 
Cooperative Science Improvement Project) was designed to address two major 
problems: 1) the difficulty faced by community college biology teachers in 
keeping pace with developments In their field, and 2) the problem of conveying 
the content and excitement of biology in cases where traditional methods are 
inadequate. 

A National Science Foundation grant was awarded to the University of California, 
Irvine, to conduct a project with Golden West College, Huntington Beach, during 
1969-71, which would bring together in two consecutive summer workshops subject 
matter specialists, instructional methods specialists, and community college 
biology teachers. It was expected that the participants would learn new 
principles and skills, develop new teaching materials, and return to their 
campuses to serve as resource persons in the design of systems-based, multi- 
media programs. Altogether, 28 biology teachers representing 23 California 
community colleges were trained In recent advances in biology and in techniques 
for designing individualized, multi-media instruction for large numbers of 
students. In addition, they developed ''mini-packets*' of st If- ins truction for 
their courses and shared these materials with other biology teachers. 

An evaluation of the processes and impacts of the project was undertaken 
during the second summer workshop and reached the following summarized con- 
clusions: 

1. The project wafj conducted in accordance with the terms cf its grant 
award* Partly due to excellent recruiting procedures, a highly 
motivated group of biology teachers participated* 

2. The project was most effective in generating participant interest and 
skill in developing courses using individualized, multi-media methods, 
specific objectives, and a criterion- refeienced approach. The project 
also stimulated limited changes In the content of certain biology 
courses. 

3. Participants generally adopted at least some of the principles advo- 
cated in the institute. Most developed a heightened sense of account- 
ability for the learning of their students and introduced at least some 
elements of se 1 f- instruction, and a criterion- referenced approach to 
teaching. Many planned and Later implemented ful ly audiotutorial ized 
courses on their campuses. Some of their courses were revised to 
include recent approaches and developments in biology. 

4. Many institutions redirected resources into the planning and develop- 
ment of audiotutorial laboratories and programs as a consequence of 
the institute. This was more evident on campuses where new science 
facilities were in planning or construction. Many colleges supported 
the participants' efforts with intramural fellowships and released 
time. 
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5. The Impact of the institute extended only in limited ways to the 
participants' departmental and campus colleagues^ mostly in the form 
of shared information and answers to inquires. 

6, Favorable effects on student achievement in the new and reconstructed 
courses were in evidence. Corroborative data from several sources 
were obtained in this area. Reliable effects of these courses on 
student attitudes toward learning could not be discerned « Some 
indication that student actitudes toward their courses functioned 
independently of the medivmi and method of instruction was detected, 

7» No evidence of enhanced articulation with neighboring institutions 
as a consequence of the institute was found. 

8. No reliable relationship between indexes obtained from the Adaptive- 
Flexibility Inventory (Brawer, 1967) and various measures of adoptive 
behavior could be found. 

9. Participants identified major obstacles they found in trying to in- 
stall new and reconstructed courses and curriculum modifications 
along lines advocated in the institute. They also related some of 
the methods they found successful in overcoming them. 
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II- BACKGROUND 

Project UCI/GWC (University of California, Irvine^ and Ck)lden West College 
Cooperative Science Improvement Project) was designed to address two majoi: 
problems: 1) the increasing difficulty faced by Junior college biology teachers 
in keeping pace with rapid developments in the state of biological knowledge and 
research techniques » and 2) the problem of conveying the content and excitement 
of biological discovery where the usual lecture- laboratory teaching model is 
Inadequate. 

The project was designed to attack these problems by bringing together In two 
six week summer Institutes a group of subject matter specialists from the 
University of California, Irvine, and elsewhere. A group of consulting Instruc- 
tional methods specialists, and a group of California junior college biology 
teachers Including primarily Instructors from member Institutions of the League 
for Innovation In the Community College. These groups met at the two cooperating 
Institutions and used the multi-media facilities at Golden West College. It was 
expected that the participants, following the lipgrading of their own current 
knowledge and teaching skills, would carry back new information and techniques 
to their colleagues at their parent institutions* 

A National Science Foundation grant was awarded to the University of California, 
Irvine, to conduct the project in cooperation with Golden West College* A joint 
directorship was set up with a faculty member from each of the cooperating 
institutions. The stated purposes of the project were to: 

1. Provide a professional environment where svibject matter specialists 
and college teachers can come together for the process of continuing 
self-renewal and self -study and development in that subject; 

2. Improve the quality and quantity of learning within the framework of 
the present biology program for increasing numbers of students; 

3. Increase Instructors* ability to utilize integrated experience 
to student learning in specific fields of study; 

4. Develop the instructors' ability to Identify responses, attitudes, con- 
cepts and skills to be achieved by the students In relation to the 
Integrated experience approach; 

3. More effectively achieve student behavior identified as desirable by 
both student and instructor; 

6. Develop methods^ materials and learning experiences that will enable 
the student to direct his own activity toward attaining goals; 

7. Evaluate the effectiveness of new teaching methods and materials 
developed in the project and to recotmnend on-going revisions for 
future curriculum changes based on the outcomes of the development; 
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8* Assist Instructors to Improve their teaching techniques by providing 

consultant and technical assistance as well as opportunities to actually 
develop program materials for use In their classrooms; 

9* Assist participants In developing new course material Including course 
content, references^ visual and other Instructional aids suitable for 
use as patterns and guides to facilitate and Improve instructional pro- 
grams in which they teach. 

It was expected that participants completing the institutes would learn skills, 
develop materials and prepare to serve as resource persons to others in their 
Institutions who would use a systems-based , multi-media approach. 

The National Science Foundation grant was awarded effective July I, 1969 to 
December 31, 1971, covering the planning and conduct of the two institutes 
during the summers of 1970 and 1971. Project planning activities were conducted 
during September. 1969 - June, 1970. in close cooperation with the California 
member Institutions of the League. Applications were solicited from biology 
teachers directly, through the Deans of Instruction of the eligible Institutions, 
and through announcements in professional publications and meetings. 

The first Institute was held on the UCI and GWC campuses during suiwner, 1970. 
with 25 biology instructors representing 23 California community colleges partici- 
pating. During the 1970-71 academic year, following the first institute, partici- 
pants developed new programs and materials for biology instruction on their home 
campuses with technical support from the project staff. A second Institute was 
held during summer. 1971, on the GWC campus with 22 of the original participants 
returning and three new enrollces participating, representing 21 California 
community colleges. Further development of new programs and materials for 
biology Instruction at their home institutions was planned by the participants 
for the 1971-72 academic year, although technical support from Project UCI/GWC 
was planned to terminate in December, 1971, 

The 25 original participants were selected from among those applicants who seemed 
most committed to improving biology education *and who had received strong 
Institutional recommendations and statements of support. The two participants 
who did not return for the second summer Institute were precluded from doing 
so because their home campus had underwritten an intensive summer effort to 
redesign courses and establish facilities for individualized, multi-media 
instruction as a consequence of their efforts following the first summer 
Institute. Three new participants joined the project during the second summer 
institute, bringing the total of the second Institute to 26 participants (4 
women and 22 men). Altogether 28 biology teachers (4 women and 24 men) partici- 
pated in all or a significant part of the project. Participants ranged in age 
from 29 to 49 years, the median age being 37 years. 

Four major activities made up the Institutes' summer programs: I) presentations 
by subject matter specialists on recent advances in selected areas of biology, 
2) in-class discussions and workshop activities on defining educational 
objectives In biology and designing media strategies for attaining them, 3) work 
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sessions with Instructional designers on applying tnul tl-medla approaches to 
biology instruction, and 4) practical, supervised experience In designing, 
developing, and evaluating program segments in biology using the multi-media 
facilities at Golden West College* 

During and following the first sumraer Institute the staff conducted its own 
evaluation activities obtaining evaluative feedback from participants and 
consulting staff in order to assess the program* s effectiveness. On the basis 
of such feedback^ the program was modified somewhat during the first summer 
institute and these data figured importantly in planning for the second summer 
institute and the interim academic year. 

To maintain and encourage communication enong participants during the academic 
year, a periodic newsletter was circulated in which the new teaching practices 
and techniques of the participants were shared. In addition, the participants 
were organized into five regional groups which then met on occasion during the 
school year to share comnon problems and to seek solutions, Following the 
second sumrofsr institute, the program modules which had been developed by the 
participants were duplicated And distributed to all participants for their 
potential classroom use* 

The evaluators were contracted at the start of the second summer institute to 
evaluate the project and its Impacts on junior college biology teaching. 
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111. STATEMENT OF THE PROBLEM 

The need to modify traditional approaches to junior college biology teaching is 
underscored by the accelerating rate at which new biological knowledge and 
research techniques are being generated and the accelerating rate of enrollments 
in the junior colleges. Teachers are faced with the task of teaching more infor- 
mation and skills to more students. Keeping pace with increasing numbers of 
students alone makes formidable the biology teacher task of keeping abreast of 
the latest developments in biological science and methodology, not to mention the 
task of learning new ways of teaching. 

This situation is not unique to biology education or even to science education. 
Similar pressures on the faculties of most other disciplines have been widely 
documented. In response to these pressures, many imaginative approaches to the 
conduct of instruction have been developing over the past decade which employ 
recent advances in communications and systems technology to better achieve 
instructional goals with large numbers of students. Significant pioneering con- 
tributions to these developments have been made by biology educators who were 
among the first to recognize the importance of applying new educational technology 
to assure quality learning in an age of expanding knowledge and enrollments. 

Many junior colleges have been developing multi-media centers and audio- tutorial 
laboratories with a view toward facilitating the use of available hardware to 
carry on certain teaching functions, to fre^ instructors from the repetitive 
functions of their activity, and to enable teachers to individualize their 
instruction for larger numbers of students. Through such pioneering efforts we 
can now document that successful instruction can be conducted through integrated, 
logical syftems of instruction which employ such resources as sound tape record- 
ings, film and slide projectors, time-shared computer terminals, vldeographic 
resources, machines designed for teaching and evaluation, and systematic appli- 
cation of psychological principles of learning. Improved systems of this type 
can provide students with diverse backgrounds, and various learning skills, 
aptitudes and interests with a more individualized tutorial approach to the 
learning process than is possible using the traditional lecture- laboratory teach- 
ing model . 

While many educators are aware that the newer educatit^nal technologies may offer 
ways of increasing their effectiveness, few have found adequate opportunity to 
prepare and use these approaches without substantial support of their efforts. 
The major obstacle to rapid adoption of these innovative teaching practices has 
been the lack of adequate time and technical support for early adopters to be 
creative, to develop useful ideas, to update their course content, and to develop 
the materials and systems necessary to conduct individualized, multi-media instruc- 
tion on a large scale. Those who have attempted to redesign their courses along 
these lines have found it essential to input an enormous amount of time and 
energy in learning new skills and in the development of special materials and pro- 
cedures Just to get ready to begin. To accomplish this while carrying a normal 
junior college teaching load has posed so great an obstacle as to frustrate the 
attempts by most instructors. 
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Accordingly, the University of California* Irvine, and Golden West College pro- 
posed a project that would enable a selected group of experienced junior college 
biology teachers, with the help of consultant specialists, to retrain themselves 
In the use of Individualized, multi-media approaches developed around the most 
recent advances in biological knowledge and research methods. The benefits of 
the project were expected to be twofold: I) the participants were expected to 
be updated tn the most recent advances In biology and to develop skills and 
materials to Implement Individualized, multi-media Instruction in their own 
courses, and 2) they were expected to return to their parent institutions as 
resource persons, there to function as change agents, stimulating the adoption of 
these approaches in their own schools and departments. Project UCI/GWC 
ulitimately resulted in the training of 28 biology instructors, representing 23 
California community colleges, in recent advances In biological science and in 
the principles and methods of designing individualized, multi-media instruction 
for large numbers of students, in addition, the participants designed and 
developed individualized Instructional modules (dubbed "mlnl^packets") for use 
in their Junior college biology courses. They then shared these materials among 
themselves and serviced a limited number of requests from faculties at other 
institutions. 

In general, It was expected that the participants would return to their home 
institutions and seek to establish the facilities needed to conduct individual- 
ized, multi-media instruction in biology, such as audio- tutorial laboratories. 
In some cases, where such facilities already existed at their home campuses, 
participants were expected to redesign their courses in this mode. In addition, 
the participants were expected to function as resource persons and change agents, 
interacting with others at their campuses and elsewhere to facilitate adoption 
of these learning models. 

The task of the evaluators was to determine the extent to which these expected 
outcomes were actually achieved following tho Institutes » Thus the evaluation 
focused upon the following specific objectives, or questions: 

1. How effective were the processes and strategies of the Institutes? 

2. How have participants modified the content and methods of their 
courses? 

3* How have participants modified their attitudes and approaches toward 
Instruction? 

4. How have the participants' parent institutions modified their curricula, 
facilities, and level and nature of support for science instruction? 

5. How have the participants' colleagues modified their academic performance 
as a consequence, either directly or indirectly, of the participants* 
experience? (What "mirror effects*' or "spinoffs" can be ascertained?) 

6. How have the attitudes and achievements of the participants* students 
been affected by their "modified" courses? 
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7. How has articulation with feeder^ receiving, and parallel Institutions 
been changed as a consequence of the Institutes? 

8« What relationships can be ascertained between the participants* person-* 
allty traits and their receptivity to modifying their courses and 
functioning as change agents? 

9. What specific criticisms, comments, and suggestions are made by those 
affected by the project regarding future projects of similar Intent? 

This report summarizes the evaluation of Project UCI/GWC, The following sections 
will discuss the evaluation methods, the findings, the interpretation of the 
findings, and some recommendations pertaining to future projects of similar 
nature. 
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IV. METHOD OF THE EVALUATION 

A tvo'^jnember evaluation ceam was formed to design the study and the Instruments, 
and to collect and analyze the data. 

The method of the study was descriptive, for the most part, based upon summaries 
of data collected using multiple Instruments with individuals affected directly 
or indirectly by the project. A correlational analysis was used to assess the 
relationships between certain personality characteristics of the participants, 
staff predictions of early adoption by participants of innovations learned in 
the institute « and ratings of actual adoptive behavior obtained nearly a year 
after the second summer institute. A correlational analysis was also used to 
assess the relationship between student attitudes toward their courses and the 
extent to which certain innovative methods learned in the institute were employed 
in those courses. 

The evaluators conducted In-depth Interviews with the project staff prior to the 
second summer institute to ascertain the objectives of the project* While the 
purposes of the project and many of its expected outcomes were stated in the 
proposal, the evaluators have found that many expected outcomes are often not 
specified in such planning documents. For this reason, the evaluation design was 
based upon both the planning documents and Interview data obtained from the pro* 
Ject staff and a sample of the project participants early in the second summer 
institute . 

Toward the conclusion of the second summer institute, the participants Evaluation 
(Form A)^, and the Workshop Evaluation (Form B) were administered to the 25 
participants in the second summer institute to obtain opinions, criticisms, and 
suggestions regarding the conduct of the project and its perceived values for 
the participants. In addition, the Adaptive-Flexibility (A-F) Inventory (Brawer, 
1967; Form C) was administered to 23 of the participants to assess the potential 
relationships between certain of their personality characteristics and their 
tendency to become early adopters of innovations, (Two of the participants 
declined to participate in this aspect of the study,) Following administration 
of the survey forms, open-end interviews were conducted with all of the partici- 
pants to obtain additional information for interpreting and verifying , the survey 
data. 

During the following year, self-instructional modules produced by the participants 
applying principles taught in the institutes were obtained and examined. These 
materials represented the only primary source of data for assessing the extent to 
which the participants had mastered the principles of individualized multi-media 
instruction taught in the institute. 

Toward the end of the academic year the Participant Followup Questionnaire (Form 
D) was distributed by mail to all of the original 28 participants to obtain 
data relevant to the impacts of the institute upon their subsequent academic 



All formal Instruments used in this study are included in Appendix A. 
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performance. Telephone Interviews were subsequently conducted with a sample of 
18 partlcipatants (647o) to stimulate returns and to obtain data for interpreting 
and verifying the survey data. Returns were obtained from 18 (6A7.) of the 
participants. 

Sets of the Biology Student Reactionnalres (Form E) were distributed to the 
participants for use in their classes in which they had Incorporated principles 
learned in the institute. The purpose of this survey was to assess the extent 
to which innovative practices had actually been adopted and their effects on 
student attitudes toward these courses. 14 class sets of this form were returned, 
representing 13 (46%) of the participants. 

Plnally^ telephone and personal Interviews were conducted with a sample of 
administrators and colleagues of the participants - Presidents, Deans of 
Instruction, and fellow teachers - representing 17 (7470 of the Institutions 
included in the institute to obtain data pertaining to the level of awareness 
of the participants! work and the level of support provided toward adopting 
Innovative teaching practices. 
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V. THE FINDINGS 

Processes of the Institute 

Ic\Ltial findings established that the project's strategies were conceived on the 
premise that Involving a number of California community colleges in a systematic 
program to update specially selected biology teachers in the current state of 
the discipline, and to train thetn to use new instructional technologies would 
contribute to improving biology education in several ways. First, the content 
and method of the participants* own courses were expected to be modified as a 
result of their experiences, thus enabling more biology students to learn current 
practices, principles, and Information* Second, it was expected that each 
participant would influence the biology curriculum at his home campus by sharing 
his experiences with his colleagues. Finally, it was expected that the effects 
of the institute would spread also to the colleges' feeder, receiving, and 
parallel institutions, Influencing biology education in nearby high schools and 
colleges. 

Care was taken in recruiting and selecting the participants for the institutes* 
Announcements were distributed to biology teachers, heads of departments, and 
Deans of Instruction throughout the state and were presented at professional 
meetings likely to be attended by science educators. The original intent was to 
recruit one participant from each institution, relying upon institutional 
recommendations to help ensure some institutional commitment and to identify the 
most promising candidates (See Statement of Institutional Reccmmendation and 
Support, Appendix B) . 

Data from both interviews and questionnaires suggest that the methods used by 
the project staff in recruiting participants were effective. Nearly two-thirds 
of the participants learned of the project through direct mall, either from 
Golden West College or from the League for Innovation in the Community College. 
Tho other third learned of the project by word-of *mouth from fellow teachers, 
supervisors, and the announcements at professional meetings* Overwhelmingly 
(847.) , the participants reported being motivated primarily by a desire to improve 
the method and content of their own courses and having received support from 
their home institutions to participate, in the form of salaried leave or release 
time* All the administrators interviewed had a high level of awareness of the 
project and the participants^ subsequent teaching activity. 

The participants' reactions to the workshop activities and their involvement in 
them were very favorable* All the participants indicated that they would re- 
enroll In the program again if they had the opportunity. More than 80X felt 
that most of their faculty colleagues could benefit from a similar experience, 
although they expressed reservations about the extent to which they could expect 
their home institutions to support innovative course development of the sort 
advocated in the institute. (It should be noted that 23 of the second summer 
Institute participants were returnees from the previous summer. Investigation 
revealed that the two who had not returned had become too heavily Involved on 
their home campuses developing new programs based upon the concepts learned in 
the previous year's institute. Three new enrol lees were taken on, every one of 
them coming from institutions already participating In the project.) 
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Singled out for particular praise were those activities requiring the participants 
to become directly and actively involved In designing instructional materials^ 
the blocks of unscheduled time provided during which they could develop their own 
ideas and projects, and the opportunities afforded in the Institute for them to 
Interact with colleagues, sharing experiences and testing new Ideas* Negative 
responses were obtained with respect to the less participatory kinds of activi- 
ties - listening to lectures, viewing television programs, and talking ABOUT 
teaching techniques Cjdig a >tis practicing them). It appears that the emphasis 
on participatory workshops, on learning by dolngt and on the development of 
Individual projects was well-received by the participants, who overwhelmingly 
expressed preference for active over more passive types of activity. 

When asked what might be added to Improve future programs of this sort, partici- 
pants* suggestions centered around both the content and methods of the Institutes. 
Most felt that more emphasis should be placed upon the design of Instruction, 
instructional methods and techniques, specification of objectives for biology 
courses, design of multi-media instructional programs, evaluation of learning, 
and less on presentations of specific biological Information. Further, most felt 
that more supervised workshop activity should be provided, more professional 
evaluation of their production, and more opportunity for interaction and communi- 
cation among themselves relevant to their instructional products and programs* 
Similarly, most recommended that formal lectures and information presentations 
be minimized since such Information was freely available to them outside the 
context of tho institutes. 

Table I below shows the frequency of responses In each category of Form A, Part I, 
representing how much time should be spent In various activities In the future. 



Table l 







[SOME MORE] 


THE SAMd 


SOME tESSi 


MUCH LES^ 


I. Field trips and excursions fe 


I 




\(> 


4 


0 


2. Discussion groups 


2 


14 


8 


I 


0 


3. Group workshops and work sessions 


I 


9 


15 


0 


0 


4. Lectures by experts and specialists 


0 


4 


9 


6 


5 


5. Testing new teaching materials 


2 


9 


13 


0 


1 


6. Preparing new teactiing materials 


0 


7 


17 


I 


0 


7. Interacting socially with colleagues 


0 


4 


19 


1 


I 


8. Consulting Individually with specialists and experts 


I 


9 


14 


I 


0 


9. Individualized study and research 


0 


4 


m. 


0 


0 


10. Getting up to date in scientific subjects 


0 


4 


15 


2 


3 


11. Learning new teaching methods 





12. Follpwup activities during the following school vear(3 ) 
N = 18 
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From these data it would appear that the patticlpanta were largely satisfied with 
the ptopottion of time spent in various activities in the institutes with the 
exception that significant proportions of participants expressed wanting more 
time spent in discussion groups, group workshops, testing and preparing new 
materials, consulting individually with specialists a.id experts, learning new 
teaching methods, and followup activities during the school year* A significant 
proportion of participants expressed wanting less time spent in lectures by 
experts and specialists. 

To obtain a measure of the participants' general attitude toward the institutes 
a Likert*-type summated rating scale was administered to the second summer 
institute participants (Form A, Part 2), The scale consisted of 12 scale items 
which allowed the participants to respond on a 4*point agree^disagree scale* 
Each response was rated on a 4-point favorable-unfavorable scale and these ratings 
were summated to obtain a single favorable^unfavorable measure for each respondent 
The lowest possible scale value was 12; the highest, 48. The theoretical midpoint 
of this possible range was 30, For purposes of interpretation^ the evaluators 
elected to consider any scale valjjes between 12 and 30 (the lower theoretical 
half of the scale) as ^'unfavorable'* toward the Institutes; values from 31 to 48 
(the upper theoretical half of the scale) as "favorable/* The scale values 
actually obtained ranged from 32 to 45, The median value was 39 and the inter- 
quartile range from 36 to 41. Thus, all the participants expressed generally 
favorable attitudes toward the institutes as measured by this scale with the 
median participant being well above the mid- or "neutral** point of the scale. 

Impacts of the Institutes 

To determine the impacts of the institutes upon the subsequent academic perfor- 
mance of the participants, on the curriculum of their schools, on their colleagues 
on their students, and upon nearby institutions, the evaluators conducted a mail 
survey of c^ie participants toward the end of the subsequent school year (See Form 
D, AppenojM A), The survey was supplemented by student reactionnaires adminl- 
stored by participants (See Form E, Appendix A) and by telephone and personal 
interviews conducted with a sample of administrators and colleagues associated 
with the participants* The following discussion summarizes the character of 
these impacts as they could be ascertained from these sources* 

How have the participants modified the content and methods of their courses ?. 
The 18 respondents expressed 30 comments relevant to this question. 61% of the 
respondents reported using essentially the same content in their courses as they 
had previously without introducing any major changes* However, 44% of the 
respondents report introducing a number of minor changes in the content of their 
courses, such as providing more detailed information, reorganizing the content, 
and attempting to include more "relevant" content while excluding the "irrelevant. 
A number of participants report having Introduced new courses following their 
participation - 22% of them. This was often described as a "splitting up" of 
content previously taught In a single course, so that certain portions of courses 
were becoming full courses in their own right* 
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A full 39% of the participants report that the major effect of the institute 
upon their teaching wds in the use of self -^instruct iondl units > behavioral 
objectives, and audio* tutorial methods of teaching. 617. report using some forms 
of student evaluation to obtain feedback on their courses - general attitude 
toward the course and specific suggestions and recomnendations to improve it. 
56% report using some form of objectives- referenced tests to assess student 
achievement of the intended objectives of the course. 44% report using some 
alternative form of evaluation, often in combination with the above techniques, 
incudlng monitoring attrition rates, colleaguial criticisms, evaluating student 
projects, and following up the success of students in follow- on courses. 

Based upon the obtained responses » the respondents were rated according to the 
degree to which they had moved toward adoption of individualized, multi-media 
teaching methods. Table 2 reports on the proportion of participants rated at 
various points on this scale. 



Table 2 



Moved substantially toward individualized, multi-media 
instruction, either establishing courses In this mode^ 33% 
developing audio- tutorial facilities, or further 
developing existing audio- tutorial programs 

Moved significantly in direction of individualized, 
multi-media instruction through introduction of 50% 
individualized study modules , behavioral objectives, 
frequent evaluation of student progress, and installing 
of accountability procedures. 



Moved slightly in direction of individualized 

instruction through some use of behavioral objectives, 11% 

study modules, or criterion-referenced evaluation* 

Virtually no movement toward individualized, multi- 

media instruction 6% 

N« 18 

From the above it can be seen that 837o of the respondents returned to their 
institutions and moved toward modifying their courses in fairly visible ways. 

To obtain an estimate of the knowledge and skills participants learned in the 
Institute, the program modules produced by the participants were examined (see 
Appendix C, Titles and Abstracts of Program Modules Produced by UCl/GWC Project 
Participants). In general the modules, or self- instructional ''Packages,*' were 
found to incorporate sound principles of instructional design, including I) a 
precise statement of objectives, 2) graduated sequence of instruction, 3) frequent, 
active, and relevant practice, 4) confirmation/correction feedback to the learner, 
5) opportunity for sel f -evaluation of progress, 6) conceptual mapping of the 
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learning task, 7) criterion-referenced post -testing, 8) appropriate illustrations, 
and the like. While some participants had developed greater proficiency in the 
preparation of the materials than others^ it was evident that all of the partici- 
pants were aware of the principles and their relationship to the learning process. 

How have participants modified their attitudes and approaches toward instructionV 

Seventy^flve comments were received from the 18 respondents relevant to this 
objective. Their comments were classified and the proportion of respondents 
commenting in each category is summarized In the following discussion. It is 
noteworthy that 83% of the respondents reported returning to their institutions 
and employing more audio-visual and audio* tutorial materials, providing more 
opportunities for practice and testing, and lecturing less than they did previously. 
In some cases i whole new courses have been established based on these methods; in 
others, greater use of these methods within substantially traditional frameworks* 
In most cases t continued increased employment of these methods appears to be 
planned. 

The Increased use of these techniques does not appear to emerge as a simple 
'^bandwagon'* effects since 56% of the respondents report use of these procedures 
in an **accountabll Ity^' context - taking responsibility to assure that planned 
achievement actually occurs. 39% report use of these techniques in a context of 
*'lndlviduallzatlonr* - providing for students to proceed toward their own targets 
according to their own abilities and needs and employing precise measures of 
achievement in relation to unambiguous statements of objectives* Additionally 
a variety of other attitudes is expressed* 22% of the respondents report 
feeling mote confident, less frustrated, and better organized in their teaching 
than previously. 287, report that they now perceive teaching as a student- 
centered, rather than a teacher-centered activity and the teachers should 
emphasize what students do, not what teachers do. 39% express the feeling that 
all motivated students can learn and that It Is the teacher's responsibility to 
assure that they do learn. And a belief in the value of Individualized, multi- 
media instruction which takes responsibility for learning was expressed, in one 
form or another, by virtually every respondent. One reported coming to realize 
that there was no such thing as ''traditional biology" since even biologists 
couldn't agree. Another expressed a deepened concern for achieving the higher 
order cognitive objectives* Two disclaimers also were expressed: one respondent 
expressed believing that the audio- tutorial approach should be part of the 
biology program, but should not dominate it. 'nother questioned whether the 
advocated approach would be useful in achieving affective objectives. 

How have the participants' parent Institutions modified their curricula^ facilities , 
and level and nature of support for science instruction? 

Data pertaining to this objective were obtained from both participants' surveys 
apd interviews with administrators. 

In the area of curriculum change, the responses of the respondents were classified 
In five categories of change. Table 3 below reports the proportion of partici- 
pants responding in each of the categories as derived from their open-ended response. 
It should be noted that two of the Ins tl tutlonsrepresented here were already 
heavily involved In curriculum revision before the Institute, so the impact of the 
Institute per se Is difficult for respondents to Identify. Interviews with college 
administrators tend to confirm these data. 
O 

ERIC 



16 



Table 3 


Major change In curriculum: New courses introduced 
or total adaptation in one or more courses to 
audio* tutorial tnode either planned or operating 


447. 


Some change in curriculum: Some content changes within 
existing courses; and/or some use of audio-tutorial 
methods within traditional courses 


67. 


Little change in curriculum: Some faculty experimenting 
within existing courses with behavioral objectives 


117. 


Virtually no change in curriculum 


28% 


Cannot evaluate because of existing high level of 
Curriculum revision activity 


117. 



N« 18 



In the area of facilities modification as well, five ordered categories of 
response were established and the proportion of respondents classified in each 
category is reported in Table 4 below» 



Table 4 



Major facilities modification: New audio- tutorial or 
similar laboratory established and/or conversion of 
room for this purpose « 


397. 


Some facilities modification: Much new instructional 
equipment acquired, and/or part of a room dedicated 
for use in audio- tutorial or similar mode 


117. 


Little facilities modification: Some new instructional 
equipment acquired 


117. 


Virtually no facilities modification 


287. 


Can't evaluate because of high level of existing 
Installation of facilities 


117. 


18 



78% of the respondents reported receiving support from their institutions for 
their efforts to implement principles and practices learned in the institutes. 
The nature of these supports ranged from simple administrative encouragements 
and a "free hand" to develop and modify their courses as they felt appropriate 
to substantial allocations of resources. The most favored forms of support 
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appeared to be (1) provision of released time and/or summer stipends dedicated 
to the development of audio-tutorial programmed materials and related activities, 
(2) employm<!nt of Instructional aides for the audlo^tutotial laboratories, (3) 
dedication of space for the conduct of audlo-tutorlat lab actlvltyi (4) allocation 
of budgeted funds for the acquisition and maintenance of audio-tutorial lab equip- 
ment » and (5) administrative encouragement. Interviews with a sample of admin- 
istrators--college presidents and deans of instructions-corroborate their pre- 
ference for these classes of support. 

Responses from participants and administrators alike suggest that there was more 
in the way of administrative encouragement than material supports* Nevertheless, 
72% of the participant respondents report some forms of material supports for 
their efforts. About 33% report major supports^ including conversion of 
facilities, provision of instructional aides, and/or provision of released time 
or summer stipends for course development. This is consistent with the data 
derived from interviews with administrators. It was not possible, however, to 
determine how much of these supports were derived from intramural, vis a vis 
extramural, sources of funds; however, one dean commented that, "as a direct 
lesult of the NSF Workshop," his Board had voted funds to support the pre- 
paration of materials and the purchase of equipment for A-T Biology, Others 
awarded intramural fellowships to pursue similar activities. 

Only 22% of the respondents report any change in budgetary supports for their 
biology programs - all Increases. Thus it appears that the implementation of 
Innovative programs is being accomplished primarily through reallocation of 
existing departmental funds rather than through new appropriations to the depart- 
ments. One respondent reports that funds formerly available for supplies were 
now being redirected to maintain the laboratory machines. However, other 
sources of funds apparently are being tapped. Both participants and admini- 
strators report that extramural contract and grant funds are being used to fund 
both the equipment and staffing requirements of these new developments. In 
many cases, capital development funds are being used to establish audio-tutorial 
laboratory facilities and equipment in new buildings. 

Have the participants^ colleaRues modified their academic performance as a 
consequence, either directly or indirectly, of the participants' experience? 

This objective was concerned with the extent to which "spinoffs" from the 
individual's participation in the institutes could be observed in the performance 
of his colleagues, both at his own campus and elsewhere. 

Of those who responded, 67% identified by name one or more members of their own 
faculty whom they believed have been influenced by them or their "modified" 
courses to make changes in their own courses consistent with the teachings of 
the UCI/GWC project. 

22% of the participants either did not respond or responded "none" when asked 
to identify such influenced persons on their own faculty. One other responded 
that he had had such an influence, but declined to name the individuals. Several 
respondents weie involved in conducting formal workshops with their own facilities 
aa well as with other faculty members dealing with these principles. 

Of those who did identify specific persons influenced by them, only one expressed 
a preference that the individuals not be contacted by the evaluators. There 
would thus seem to be a confidence among the respondents that these named faculty 
would confirm the participant's influence. Telephone interviews with several 
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of these named colleagues did confirm the respondent's influence. Of those who 
do identify specific "influenced" Individuals, an average of 2,25 persons is 
named. Thus, on the average, it would appear that the participants are 
influencing one or two other persons at their own campus toward adopting the 
principles advocated in the Institutes. 

When asked to name individuals at other Institutions who have been influenced 
by them or their courses^ 78% of the respondents either responded "none" or 
did not respond at all. 17% responded by naming one or more specific individuals. 
One of the respondents (6%) responded affirmatively but could not name specific 
individuals because his college is so heavily involved in individualized, multi- 
media instruction. Another respondent named some 55 participants in a workshop 
which grew out of the UCI/GWC project and was funded through the vocational 
educational provisions of the Education Professions Development Act. 

How have the attitudes and achievements of the participants' students been 
changed by their "modified" courses ? 

With respect to achievement, 24 relevant comments were returned by the 18 
respondents. The conments were categorized and the proportion of individuals 
responding in each category is reported in Table 5 below* 



Table 5 



Unable to assess 


33% 


Have observed little if any 


11% 


change 


Have observed favorable 




change 


56% 


N« 18 



Of those reporting observing favorable changes in the achievements of their 
students, 90% report clear Increases in the proportions of As and Bs and 
corresponding reductions in the proportions of Ds and Fs awarded in their 
comparable courses in the past. One respondent reports an increase in the pro- 
portion of course completions over his previous offerings; however, three 
respondents report increases in the proportions of wlthdrawls. 

It is clear that the introduction of individualized Instruction of the type 
taught in the institutes has called for some new approaches to handling with- 
drawls. Apparently institutions have developed varied approaches to this issue. 
If the unmotivated or less able students become aware early of their lack of 
success in a course and are permitted or encouraged to drop without penalty 
during the term, the proportion of As and Bs may increase simply by attrition. 
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Apparently this approach has beea used by some. Others apparently tend toward 
discouraging withdrawal and concentrate on Improving the performance of these 
students. It would appear from the responses, however, that where student 
achievements Improved in these reconstructed courses^ the Improvement apparently 
affected all students across the board, as the proportions of course completions 
with grades of C or better substantially Increased. 

Many teachers report conducting formal comparative evaluations of the changes 
in levels of achievement to back up their claims; however^ only 12% provided 
the evaluators with any quantified response* Based upon' these It Is estimated 
that In these modified courses the proportion of As has Increased 5-20%; Bs, 
15-25%; the proportion of Cs^has decreased 15-20%; and Ds and Ps have been 
virtually eliminated. 

With respect to changes In student attitudes toward learning generated by 
modified courses, only 17?i of the respondents reported falling to observe any 
evidence of attitude changes> acknowledging either that no evaluation of this 
dimension was conducted or, In one case> that no opportunity existed to evaluate 
the effects on students attitudes. 

The participants offer little In the way of documentary evidence to support their 
reports In this area, but the fact that 83% express positive feelings about 
Improved student attitude Is noteworthy. If the students are "turned off" or 
respond negatively to an innovation, the teacher Is quite likely to be the first 
to know It. The responses of the participants were categorized and the pro- 
portion of respondents responding in each category Is reported In Table 6. 



Table 6 



Favorable changes In enrollments and withdrawals 


50% 


Other favorable Interest related behavior; more 
active discussions, increased span of attention 
and activity, etc. 


39% 


Increased number and quality of special reports 


22% 


No observed changes in students' attitudes 


17% 


No response 


6% 


N* 18 



Some corroborative data were obtained from college records. As an example, one 
Instructor's student drop rate and grade distribution changed as follows: 
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Table 7 





Withdrawals 


Percent 
Receiving 
As & Bs 


Mean GPA 


Prior Record 


517. 


35% 


2.3 


Following 
Workshop 


1*1% 


507. 


2.6 



N« Not Reported 



His dean concluded that the Instructor's "participation In the college Science 
Improvement Program did improve his teaching performance," 

A Biology Student Reactlonnaire was administered to samples of students in lA 
"modified" courses (See Appendix A, Forme B) . It was hypothesized, based upon 
the assumptions of the institute'^ rationales, that the extent to which innova- 
tive processes were Introduced In a course would be positively related to 
affirmative student attitudes » Conversely^ it was hypothesized that the extent 
to which traditional procedures were used would be negatively related to affirm- 
ative student attitudes » To obtain measures of the extent to which innovative 
practices had been instituted in these courses, vis a vis traditional practice8» 
samples of students were asked to estimate the proportion of time they spent in 
various instructional activities* The median percentage of time reported in "Group 
Lectures" was taken as a measure of "traditional practice" for each of the 
classes reporting. The median percentage of time spent In "programmed Instruction" 
was taken as a measure of "Innovative practice" for each of the classes reporting. 
To obtain measures of student attitudes toward these courses, a Likert-type 
summated rating scale was employed using a 5*point agree-dlsagree continuum for 
each of six attitude items Imbedded In a larger, 15-Item questionnaire. Scale 
values of 6-30 were possible, the theoretical mid-value being 18. The median 
attitude value was taken as the attitude measure for each of the l4 reporting 
classes. A Speanoan rank order correlation coefficient was calculated to 
express the relationship between these measures. No reliable correlation w4s 
found to exist between the amount of "Innovative practice" and "affirmative 
attitudes" of the students. Neither was any reliable correlation found to exist 
between the amount of traditional practice" and "affirmative attitudes" of 
students. Thus, the expected relationship between student attitudes toward 
their courses and certain traditional and innovative practices employed in those 
courses could not be confirmed. On the basis of the evidence obtained from this 
survey of students, it might appear that attitudes toward courses are independent 
of these method-media variables. If this Is so, then student attitudes toward 
courses may be more related to variables other than those specifically evaluated 
In this study and specifically addressed by the Institutes. While these expected 
relationships were not confirmed In the study. It should be observed that the 
median scale value across all of these courses was 22.5, well above the 
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theoretical central value of the scale. Thls> together with the fact that the 
lowest median scale rating for any class was slightly above the theoretical mid- 
point o£ the scale) leads us to conclude that the students In these courses were 
largely satisfied with them. Further, examination of specific crltlclsros by 
those students whose attitude scores Indicated general dissatisfaction with the 
tnodlfled courses reveals the following typical reasons for their criticism: 

1. Poor organization c ^ materials 

2. Instructions not clear 

3. Lack of facilities po perform requirements 

4. Too much work for number of units earned 

5* Inability to take responsibility for own activity. Need for 
more structure 

6. Too much "busy work." "Doing" not always the best way to learn. 
Sometimes a simple verbal explanation would be enough. 

7. Poor test questions. Don't always allow student to show what 
he knows , 
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Mow has articulation with feedeti receiving, and parallel institutions been 
chaaged aa a consequence of the Insti tutes? 

Little evidence of any spinoff to other institutions - high schools, other 
community colleges, or 4-year colleges - was found in the study. Sixty-seven 
percent of the respondents report no interaction with individuals at such 
institutions* 227* report some miniraal level of Interaction, usually in the form 
of responses to inquireSt showing and explaining their facilities to visitors^ 
and some conversations with counterparts at these schools. 

Two respondents (1170 report participating in the conduct of a 4-weekend workshop 
jointly sponsored by three contmunlty colleges, a community college district, and a 
county office of education on "Individualizing Instruction through Program Develop- 
ment/' Individuals from five unified school districts, three high schools, and 
three other community college districts attended the workshop, which was funded by 
USOE under an EPDA, Vocational Education grant. Another has planned similar work- 
shops, but primarily as an outgrowth of participating in another vocational edu- 
cation project (Project CISTRAIN) which focused on the training of change agents. 

When asked if they could identify colleagues in other institutions who have been 
influenced by them to modify their teaching in ways consistent with principles 
advanced in the UCI/GWC project, 78% of the respondents could identify no such 
colleagues, 177* of the respondents were able to >do so* One respondent claimed 
having such Influence but was not able to identify specific individuals because 
of the heavy audlotutorlal program at his own campus. 

The evidence suggests that the workshop has had little effect upon articulation 
with other educational institutions. 

What Relationship can be ascertained between the participants' personality 
traits and their receptivity to modifying their courses and functioning as 
change agents ? 

One concern of the study was to attempt to relate certain personality character* 
Istlcs with the tendency to Implement innovative teaching procedures. In this 
case, the Adaptlve-Flextbil tty (A-F) Protocols (Brawer, 1967, Portn C) were used 
to assess the relevant personality dimensions, (See Appendix D: Evaluation of 
Adaptive-Flexibility Protocols of Cooperative Science Improvement Project 
Participants/) 

Subsequently, the scores obtained from these scales were correlated with staff 
predictions of participant adoptive behavior obtained following the institutes. 
Jhen toward the end of the subsequent school year, actual implementation ratings 
of the participants were made by a single rater based upon their Forms D & E, 
assessments of their students, and their own accomplishment reports. In a final 
comparison, the actual implementation ratings were related to the participants' 
attitudes toward the institutes as measured by an analysis of their Form A. 

All four mer^ures (staff predictions, A-F Implementation scores, attitude 
toward' the- institutes scales, and ratings of actual performance) were obtained 
from 16 (577.) of the original 28 participants. Table 8 on the following page 
reports the rankings of the various participants on these several measures. 
The rank-order correlations between the various measures are reported also In 
Table 8. 
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Table 8 







Rank on Various Measures 


Participant 


W 


X 


Y 


z 




Attitude- 
toward-the* 
Institutes 


A - P 

Implementation 
Ratings 


Staff 

Prediction 
Ratings 


Actual 

Implementation 
Ratings 


I 


13.5 


13 


15.5 


16 


2 




6.5 


9 


2 


3 


I 


6.5 


4 


10 


t^ 


4.5 


15 


9 


4 


5 


9.5 




9 


3 


6 


2.5 


2 


9 


8 


7 


4.5 


6.5 


13.5 


12 


8 


11.5 


13 


1.5 


14 


9 


7 


6.5 


4 


U 


\o 


U.5 


6.5 


15.5 


13 


11 


13.5 


2 


Q 


7 


12 


6 


13 


9 


I 


13 


2.5 


13 


4 


5 




o 
o 


6.5 


1.5 


9 


15 


9.5 


13 


9 


6 


16 


15 


2 


13.5 


15 


N* 16 










Rhowz = +.23 
RhOxy * -.Oil 




Rhoxz 
Rhoyz 


» -.190 
= +.268 




None of the 


above correlations is statistically significant 
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Based upon analysis of these data, the expected relationships could not be con- 
firmed* Virtually no correlation was found between the A-F Implementation 
values and either staff predictions or actual performance ratings. Slight but 
unreliable positive correlations were found between staff predictions and actual 
performance ratings (RHO « +.268) and between attitude toward the Institute 
values and actual performance ratings (RHO « +,23) • Prom the available evidence 
it is not possible to conclude that the A-F Inventory employed in this study yet 
possesses the sensitivity necessary to discriminate high potential early adopters 
of innovations and/or change agents. 

V?hat specific criticisms^ comments, and suggestions are made by those affected 
by the project regarding future projects of similar Intent? 

When asked to describe the major obstacles they faced in attempting to restruc- 
ture established courses » reorganize the curriculum, or redesign teaching 
strategies In their cotnmunlty colleges > the respondents identified an array of 
difficulties. The major obstacle, as 657, of the respondents identified it, was 
the lack of operational support for such programs - lab assistants, access to 
computers, maintenance of test flles^ audio^vlsual production services, dupli- 
cating, typing, supplies and the like. Closely following in frequency, lack 
of their own time for the development and planning of restructured courses was 
named by S9% of the respondents. The same number also named lack of capital 
facilities for conducting A«T instruction* 

Forty-one percent named faculty resistance as a major obstacle to modifying the 
curriculum and departmental approaches to Instruction. Their own inertia 
(resistance? fear?) was named by 18% as a major difficulty in getting started. 
And 12% named conflicts with existing regulations governing grading policies 
and the required presence of the teacher at all times as a major difficulty at 
their institutions. 

Mentioned, though less frequently, were lack of student discipline to handle the 
responsibility of individual ited learning, their own fear of failure, and fail- 
ure to gain the acceptance of colleagues. 

In all, 94% of the respondents reported encountering obstacles of various kinds 
at their home campuses. One person claimed to have faced no obstacles. 

What methods have these participants found to over the obstacles? Not many 
surprises, and certainly no breakthroughs were included in the responses. Just 
do it, they say, paying no attention to the obstacles. In a spiritual mode, 
they say "overcomel" In a practical mode, they say to be patient and explain 
to colleagues what you are doing as frequently and as candidly as possible. 
Be prepared to answer questions and seek support for your program in face^to- 
face encounters behind the scenes. Avoid public confrontation and adversary 
relationships. Be prepared to wo^k overtime if needed and to spend your own 
money in the early stages. 



25 



Don't get discouraged, they say, Flt\d a sympathetic colleague and work with 
him. The support of but one person can sustain you. Present a reasonable 
program, and don't try to move too rapidly. Don't get too far In front of 
your colleagues, Just far enough that you make progress and that each step seems 
reasonable. 

Pay attention to both upward and lateral communications. Keep both colleagues 
and administration informed of what you are doing. Seek their support and 
cooperation. Write grant proposals « Extramural support is often recognized 
more quickly as program certification. Intramural support may follow more 
easily thereafter. Be sure everybody gains-- let everybody share in the successes 
when you have them. Don't hog the glory when it comes* 

Looking back over the entire project, what specific suggestions and recommenda- 
tions do the participants make regarding future institutes of this kind? 
Generally, the respondents were very supportive of this institute. Most of their 
suggestions proceed from the assumption that similar workshops might be held 
in the future and these are their major suggestions to improve upon them. 

Several of the respondents asked for a more thoroughgoing reexamination of the 
goals of science education and, in particular, the role and function of the 
community college science curriculum within that framework. 

Clearly, mixed feelings prevailed among the respondents with respect to the 
use of scientists and researchers In such institutes. They did not enjoy, nor 
did many express perceiving tuuch value in the "lecture" approacL used by the 
subject-experts In this institute* The majority expressed preferring more inter- 
action with these subject-experts on recent advances in their fields, and more 
involvement with "hands-on'* and "how- to-do- it" experiences. 

Several mentioned a need for more Interdlsclpllnarlty In the science Institutes - 
more opportunity to view the sciences against a backdrop of many disciplines « 

There was a general expression of feeling that the institutes might focus more 
attention on the gentle arts of "grantsmanshlp*" Most community college 
faculty members have had precious little experience In Applying for extramural 
supports, and some systematic training and practice In this area they claim 
would benefit them. Similarly, some expressed the view that NSF might be more 
helpful In getting budgets turned around In favor of science education. Built 
In provisions for college participation In major projects was one of the methods 
mentioned along these lines. 

Some mentioned individual Interests In certain specialized topics and expressed 
interest in more shorter-term workshops on these more limited topics. For the 
longer institutes, however, such as this one, they expressed needing more 
interaction and technical support during the academic year between the summers « 

Overall, however, ^he central thrust and conduct of this institute was reaffirmed 
often and enthusiastically. 
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VI. INTERPRETATION AND RECOMMENDATIONS 

The processes and strategies of the UCI/GWC Project were most affective in 
generating and maintaining participant Interest In revising course methods and 
in developing skill in applying recently developed principles and techniques of 
instruction to individualizing their courses. The institute generated some 
changes in course content as well> but not to the extent that it generated 
changes In the organization and methods of Instruction. 

The institute was also highly effective in modifying participants' attitudes 
toward instruction. There was widespread adoption of the use of objectives and 
a criterion- referenced approach with greater awareness of the need for instructor 
accountability for student learning. In addition, audio-tutorial methods were 
adopted by many of the participants* 

Some limited spread of effect was observed araong the participants* colleagues - 
some interest In the use of objectives, criterion* referenced Instruction, 
audlotutorlal methods, and an occasional trial. When observed, these effects 
tended to be within the participants' own departments, although isolated cases 
of wider Influence were also discerned. In general, the Impact of the Institute 
on the participants' colleagues and counterparts appears to have been quite 
limited. 

As to the conduct of the project Itself, the summer Institutes were directed In 
accordance with the proposal and the participants reacted about as might be 
expected. A high level of involvement on the part of the participants and 
directors alike was experienced. Except for two persons who had begun work on 
revising their courses on their home campuses, all the first year participants 
returned for the second year* 

The selection of participants for the Institute was well-conducted* Still, a 
great deal of appeal existed In the Idea that innovations might be accelerated 
if persons could be selected for this training who had a high probability of 
becoming early adopters of innovations and/or change agents in their own 
academic communities. A test of the A^F Inventory as a possible tool for this 
purpose proved It unable successfully to differentiate among the participants 
on this basis. One explanation is that, because of the careful selection pro- 
cesses conducted by the directors, the group possessed a high degree of homo- 
geneity on the relevant personality traits. This interpretation tended to be 
supported by the narrow range of variance obtained on the A-F Implementation 
ratings. As corroborative evidence of this condition, it was found that the 
institutes staff were unable, following the institutes, to predict reliably 
differences in the subsequent adoptive behavior of the participants* This 
supports the general notion that participants for similar Institutes should be 
similarly carefully selected - Indeed should be encouraged to select themselves - 
In order to ensure a similar high proportion of motivated participants. 

Although the participants were quite active in revising their own courses and 
curricula during the year following the institutes^ their influence on colleagues 
tended to be slight. While a few conducted workshops for other staff members 
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at their collegesi most spent their time primarily on their own programs. This 
suggests that if future Institutes are to be directed toward the participants' 
influencing their colleagues, some provision for deliberate effort in this 
direction seems to be a needed component in the statement of work. 

The evaluation revealed no indication that inter-institutional articulation was 
enhanced. Although some participants consulted with their departmental 
colleagues on innovative Instructional processes, few if any made contact with 
biology instructors at other institutions. Thus, the institutes yielded little 
in terms of impacts on neighboring institutions. 

The high level of increase In student achievement In the revised courses was 
most encouraging. Fewer withdrawals and a higher percentage of As and Ba 
evidenced a high degree of success in course reconstruction. The institute was 
Most successful in this area, directly affecting student achievement and 
attitudes for the better. However, some apparent lack of student enthusiasm for 
the autolnstructional techniques was detected. This seemed to indicate a 
possible overzealousness in some cases in converting to the use of self-instruc- 
tional methods to exclusion of other effective techniques, and before adequate 
preparations had been made. Some care needs to be taken in the conversion to an 
audiotutorial system to ensure that an appropriate level of planning and develop- 
ment of materials and resources has occurred prior to installation. 

Furthermore, care needs to be taken to ensure that too much practice on trivialities 
does not turn effort away from essentials. Other studies tend to confirm the 
wisdom of using a '*lean programing" approach - that is, the development of audio- 
tutorial materials by adding, little by little, only that practice shown to be 
essential for effective learning. Without such care, we may find that an inept 
introduction of an audiotutorial system may lead to boredom, frustration, and 
attendant disaffection with the media form itself. This finding would be con- 
sistent with the findings of other cross-media and cross-method evaluation studies 
which tend to support the independence of attitudes from method and media 
variables. 

It would appear, then, that teaching which favorably affects student attitudes 
toward learning may be conducted in both traditional and innovative modes. In 
other words, simply employing audiotutorial methods and multi-media presentations 
is no guarantee that students will come to love the course* Students quickly 
recognize poor teaching in whatever mode it is presented. The data from these 
studies suggest that to gain favorable influence over student affective response 
to a course, teachers must attend to more than mere methods and media of 
presentation. A careful selection and organization of the students' learning 
activities and experiences would seem to be at least as Important as the choice 
of media for presentation and response. 

Considering that the new courses evaluated in this study tended to be in early 
developmental stages, often in their first or second term of full scale implemen- 
tation, the results must be judged to have been quite effective. The data point 
to substantial positive outcomes in both the cognitive and affective areas, and 
some increased efficiencies in the conduct of the courses. Some important 
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techniques and principles were Introduced beyond simply the audlo*tutorlallzing 
of courses. Sone Include the use of specific objectives, a criterion-referenced 
approach, developmental revision of courses based upon systematic, empirical 
evaluation, and built in provisions for Instructor accountability for the 
results of instruction. This leads the evaluators to conclude that these new 
and reconstructed courses, in the maini have been successfully Introduced and a 
sound basis has been provided for them to be strengthened and improved over time. 
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DATA-GATHERING INSTRUMENTS 
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UCI/GWC COOPERATIVE SCIENCE IMPROVEMENT PROJECT 

Workshop Evaluation Form 8 

As part of the program evaluation, we need your comments in regard to the 
following questions: 

1. How did you first learn of the workshop? 

2. What was your prime reason for getting involved with the workshop? 

3. Why do you think the other participants came? 

4. If you had it'to do over again would you enroll? 

Yes No 

5. What single facet of the workshop did you find most helpful? 

6. What facet was irrelevant or detrimental to your learning? 

7. In your judgement what was most helpful for the other participants? 

8. What would you suggest adding to future workshops of this type? 

9. What proportion of the faculty at your own institution do you feel could 
benefit from a workshop of this type? 

B-l 
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10. Using your own skills and interests as a benchmark, was the workshop paced 
and sequenced properly? Elaborate. 



11. When you return to your institution, what new teaching techniques will 
you introduce? 



12. How many other instructors at your college or neighboring institutions do 
you anticipate adopting portions of the techniques you learned or materials 
you prepared? 



13. Any other comments? 



B-2 
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UCI/GWC COOPERATIVE SCIENCE IMPROVEMENT PROJECT 

Adaptive-Flexibility Inventory Form C 



A-F Form B-2 
Copyright 1967 by 
Florence B. Braver 
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DIRECTIONS 



Thl0 is an exercise to see how different people react 
to different words. 

You will find l80 words listed on the following pages. 
You are asked to respond to the words by writing down^ in 
the blanks provided, the very first word or thought which 
enters your mind. Please do not question your own reactions 
but record your immediate intpressions whatever they are. 
If a word doesn't quickly come to your mlnd^ Just go on to the 
next word. 

This is not a timed task, however, please try to work 
as quickly as possible. 



A-F WORD ASSOCIATION LIST 

1 . Cap 

2. Glass 

3. Smile 
A. Style 

5. Marriage 

6. Cloud 

7. Dream 

8. Scream 

9. Ambiguous 

10. Desire 

11. Liar 

12. Entertainment 

13. Enticement 

14. Fear 

15. Dear 

16. Butter 

17. Fly 

18. Argur 

19. Chattel 
ERiC- Anatomy 



21. Peak 

22. Neck 

23. Fog 

24 . Frog 

25. Sports 

26. Campus 

27. Cheat 

28 . Choke 

29. Please 

30. Tease 

31. College 

32. Fall 

33. Satin 

34. Sensitive 

35. Ink 

36. Croup 

37. Soup 

38. Cock 
3$. Tall 



41. Complex 

42. Conundrum 

43. Dirt 

44. Test 

45. Integration 

46. Fair 

47 . Anxious 

48 . Wonder 

49. Full 

50. Cold 

51. Mask 

52. Marble 

53. Grade 

54. Devotion 

55. Hit 

56. Needle 

57. Bible 

58. Mine 

59. Clean 
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61. 
62. 
63. 
64. 

65. 

k 

66. 

67. 
68. 
69. 
70. 
71. 
72. 
73. 
74. 
75. 

« 

76. 
77. 
78. 
79. 

ERiCso. 



Excitement 

Work 

Friend 

Proselyte 

Dance 

Pun 

Satisfaction 

Bontb 

Control 

Symbol 

Date 

Late 

Open 

Abortion 

Hammer 

Head 

Slush 

Pest 

Soft 

Fat 



81* Pate 

82 • Laboratory 

83 < Squeeze 

84, Shadow 

85, Punch 

86, Pinch 
87* Sea 

88. Tough 

89. Drink 

90. Sink 

91. Dare 

92 . Moon 

93. Noon 
9A. Problem 

95. Future 

96. Bad 

97. Red 

98. Snake 

99. Home 
ER^ ^ Blood 



101. Judge 

102. Tense 

103. Line 

104. Student 

105. Beautiful 

106. Face 

107. Trap 

108. Sap 

109. Press 

110. Flexible 

111. Fight 

112. Tight 

113. Pass 

114. Value 

115. Me 

116. Moiety 

117. You 

118. Attack 

119. Touch 
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121. Luck 

122. Fur 

123. Love 

124. Blue 

125. Splice 

126. Rat 

127. Bat 

128. We 

129. Advise 

130. Seek 

131. Obedience 

132. Table 

133. Ideal 

134. Love 

135. Prude 

136. Nut 

137. Hut 

138. Smear 

139. Sterile 
ERIC 140. Nearness 



141. Life 

142. Blotch 

143. Crawl 

144 . Win 

145. Frown 

146. Trouble 

147. Wet 

148. Pet 

149. Ring 

150. Virtue 

151. Arouse 

152. Study 

153. Peace 

154. Sink 

155. Tomorrow 

156. Rock 

157. Sensation 

158. Rod 

159. Vice 
ERjCO- serendipity 



161. 
162. 
163. 
164. 
165. 
166. 
167. 
168. 
169. 
170. 
171. 
172. 
173. 

m. 

175. 
176. 
177. 
178. 
179. 

180. 



Set 
Met 
Mate 

Imagination 

Period 

Love 

Soft 

Career 

Learn 

Go 

Permit 

Black 

Lay 

Door 

Soar 

Egg 

Life 

Love 

Time 

Core 
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You've responded to a lone series of varied words* Will you now 
please help us further by answering the following questions^ as 
best you ean? 

Your name ^ ^ 

1» What is your age? 

2. Your sex? Male Female 

3* Highest degree? \ 

k. Father *s occupation? 

5- Mother •s occupation? 

6» How many years have you been teaching?^^ ^ 

?• Five years from now^ what would you like to be doing? 



8. Ten years from now? _^ 

9* Which of the following age spans do you consider to be the happiest 

years of one's life? Please check one. 

1 - k 

5 - 9 

10 -lU 

15 -19 

20 -29 

30 -39 

l+O -1^9 

50 -59 

60+ 
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EVALUATION AND RESEARCH ASSOCIATES 



2010 LINNINQTON AVENUE 
LOS ANQEIES. CAlt FORM lA 



12 May 1972 



We are now completing the final stages of our evaluation of the University 
of California, Irvine/ Golden West College Cooperative Science Improvenient 
Project In which you participated during 1969-71* Our intent is to ascer- 
tain the effects of the project upon your teaching practices and upon the 
curriculum at your school. 

We need three types of information: 1) the ways in which you actually were 
able to put new concepts into practice since starting in this project, 
2) your intentions and plans for the future, aj\d 3) what difficulties you 
way have encountered in attempting to incorporate into your courses the 
teaching strategies and concepts taught in the project. In our report to 
the National Science Foundation we hope we will be able to recommend alter- 
natives designed to overcome such difficulties in the future. 

Please be assured that your responses will be kept in strict confidence* 
We will be trying to report an overall picture of the impacts of the project 
rather than personalized anecdotal information. Your frankness and candor 
will be appreciated and your anonymity respected. 

You will find two types of forms enclosed with this letter. Please complete 
the Participant Followup Questionnaire (Form D) and return it to us by 
May 19, 1972, or as soon thereafter as possible. Please distribute the 
25 copies of the Biology Student Reactionnaire (Form E) to a random sample 
of your students enrolled in a course in which you have incorporated concepts 
taught during the project. Have them complete the React ionnaires , collect 
them, and return them to us by May 26, 1972, or as soon thereafter as possible. 
Stamped return envelopes have been provided for your convenience. 




Marvin J. Rosen, Ed.D. 
Arthur M. Cohen, Ph.D. 
Co-evaluators 
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EVALUATION AND RliSEARCH ASSOCIATES 
2010 Linnington AvefiUe 
Los Angeles, California 9002S 



(213) 474-2028 



Form D 



UCI/GWC COOPERATIVE SCIENCE IMPROVEMENT PROJECT 
PARTICIPANT FOLLOWUP QUESTIONNAIRE 



As you are aware^ the general purpose of the National Science FoundationVs 
Cooperative Science Improvement program is to improve the quality of science 
education. Institutions vary in their approaches to this task. The UCI/GWC 
Project, for example, focused upon improving the content and methods of 
biology instruction in community colleges by providing a two-summer long 
training experience for biology teachers representing over 20 California 
comntunity colleges. 

In our earlier interviews with you, we obtained your reactions to the work- 
shops themselves, and to the conduct and content of the project. In this 
followup questionnaire we are primarily interested in the impacts of the 
project upon your teaching, and upon the instructional program at your school. 
We ask you to report any changes you have made in your approaches and methods 
which you attribute in large measure to the project. In addition, we ask you 
to report any observed changes in the knowledge, skills, and attitudes of 
students which may be attributed to these modified approaches. We will also 
ask you to report about other teachers who may have initiated new teaching 
procedures which appear to be a consequence of their interaction with you, 
or of their observation of your courses in action. 

The questions are open-ended, so please feel free to include as much information 
AS necessary to inform the evaluators. Use additional sheets if necesssary. 
MOST IMPORTANT: include examples and specific anecdotes to illustrate your 
general impressions and inferences. If possible, append any formal data you 
may have, such as summary records of dropout rates, grade distributions, 
standardized and classroom test scores, attitude or interest surveys, 
course evaluations, and the like. 

Your cooperation is urgently requested in order that this final stage in 
the evaluation of the UCI/GWC Project can be concluded within the current 
school year. Please take a moment to complete the questionnaire now, and 
return it to us at the above address by May 19, 1972, or as soon thereafter 
as possible. 




Marvin J. Rosen, Ed.D. 
Arthur M. Cohen, Ph.D. 
Co-evaluators 
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UCI/CWC COOPERATIVb SCIENCE IMPROVEMENT PROJECT 

Participant Followup Questionnaire Form D 



Name Phone (Home) (Office) 

Employer (College) \ 

Employer's Address City ; 



1« Describe any major changes you have made in the content of your biology course(s) 
which grew out of your participation in the UCI/GWC Project. 



2. Describe any major changes you have made in your teaching methods , or in 

your course design which grew out of your participation in the UCI/GWC Project. 
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3, Describe any observed behavior of your students which you believe reveals 
attitude changes resulting from course improvements made since your parti- 
cipation irTThe UCI/GWC Project, (Include summary data if available on 
enrollments > drops, requests for tutoring, inquiries, special reports or 
projects, or other interest- related bclmvior,) 



4. Describe any observed changes in the achievements of your students which you 
believe result from course improvements made since your participation in the 
UCI/GWC Project. (Include summary data if available on grade distributions, 
awards^ honors, test scores, etc.) 



ERLC 



S, In what ways^ if any, would you say your attitudes, approaches to teaching, 
and teaching methods have changed as a consequence of your participation in 
the UCl/GKC Project? 

A. Attitudes toward instruction: 



B, Approaches to instruction: 



C. Methods of teaching 



50. 

6i In what ways, if any, has your college altered its Biology program as a 
consequence! either direct or indirect, of your participation in the 
UCI/GWC Project? 

A. Changes in curriculum: 



B. Changes in facilities: 



C. Changes in nature of support: 



D. Changes in level of support: 



E. Other changes: 
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7* From your own knowledge, has your participation in the UCI/GWC Project affected 
in any way the level or content of communication (or articulation) with any 
high schools » 4-year colleges or universities, or other community colleges? 
If so, give examples: 



8. Describe what procedures you use to evaluate your teaching and the effective- 
ness of your courses* To what extent have these procedures revealed any 
changes which you believe result from your participation in the UCI/GWC 
Project? Include summary data, if available: 
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* From your own knowledge, can you identify other msmbers of your faculty who 
have been influenced by you or your courses to make changes in their own 
courses and methods consistent with the teachings of the UCI/GWC Project? 
If so, please list them by name and course title: 

Name Course Title(s) 



Vou may contact the above if you wish 

^ Check one 

I*d prefer you did not contact the above 
(Your preference will be respected.) 



10. From your own knowledge, can you Identify colleagues in other institutions 
who have been influenced by you or by your courses to make changes in their 
own curricula, courses, or methods consistent with the teachings of the 
UCI/GWC Project? If so, please list them by name and institution: 

Name Institution 



You may contact the above if you wish 

V Check one 

I'd prefer you did not contact the above [[j 
(Your preference will be respected)* 



} 
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11, In your judgement, what are the major obstacles one is likely to face in 

restructuring established courses, reorganizing a curriculum, or redesigning 
. teaching strategies in a conununity college? Give examples if you can from 
your own experience: 



12, Which of thesk* obstacles have you encountered and what steps have you 
foxind successful in overcoming them? 



54 



13. Use the following space to give your specific suggestions, criticisms, 
and recoimnendations for future projects intended to improve science 
education in community colleges. Your comments may deal viith any topics 
of importance to you. 



14» We wou^d like to interview other persons familiar with your work. Please 
identify by name and title some individuals we might contact who have been 
aware of your participation in the UCI/GWC Project and your subsequent 
activities « 



A. 



C. 



Your department or division chairman 



Another teacher at your school 



D. 



A colleague at a nearby high school or college 

Any other person (unaffiliated with UCI/GWC Project) 



Phone 



Your Dean of Instruction, or equivalent 



Phone 



Phone 



Phone 
Phone 
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15. Comparative Course Descriptions and Materials , Can you provide materials 
from your courses? We would like to see what kinds of changes you have 
iinplemented since participation in the UCI/GWC Project. Please send any 
materials you may have which would allow us to compare such items as 
course outlines, schedules, assignments, reading lists, and so forth 
before aa^d after /our participation in the project. (We are not interested 
in evaluating your courses, but in observing what kinds of changes you 
have made in them.) If course syllabi exist, we would appreciate receiving 
one. If befove and after versions exists we would appreciate receiving 
both. If you can't send the actual materials, describe the before and after 
differences in your courses as you believe them to be, (Note: do not send 
your self- instructional packages • we already have copies •) 



16. If you have a course which incorporates science concepts and/or teaching 

methods taught in the UCI/GWC Project, we would like to obtain some reactions 
of students enrolled in it. We have enclosed 25 copies of a Biology Student 
Reactionnaire (Form E) for use in such a course. Please distribute these 
React ionnai res to a RANDOM SAMPLE of students enrolled in the course and 
have them complete it. This can be done in less than 10 minutes. Then 
collect the completed Reactionnaires and return them to us under separate 
cover before May 26, 1972, or as soon thereafter as possible. A special 
return envelope has been provided for this purpose. (Note: Return Form 
E intact - do not separate the pnges.) 
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-Many thanks for your help- 
O-IO 
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EVALUATION AND RESEARCH ASSOCiATtS 
2010 Linnington Avenue 
Los Angeles, California 90025 

(215) 474-2028 Form E 

UCl/GWC COOPERATIVE SCIENCE IMPROVEMENT PROJECT 
BIOLOGY STUDENT REACTIONNAIRE 



We are conducting a survey of student reactions to certain biology courses 
as they are taught in California coimunity colleges. We are trying to find 
out what methods of teaching are most effective and most preferred by 
students. 

/■ 

Your teacher has shown an interest in improving the effectiveness of this 
course and you have been selected to participate in this survey. Your 
frank and candid response to each question will be appreciated. Please use 
the back of the form to add any additional comments you wish to make* 

This is a statewide survey and your reactions will not be used in assigning 
grades for your course work. DO NOT SIGN YOUR NAME TO THIS FORM. 

Please coniplete the Reactionnaire and return it immediately to the person 
who gave it to you. We ask only a few minutes of your time* 



-Thank you for your help* 
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UCI/GWC COOPERATIVE SCIENCE IMPROVEMENT PROJECT 

Biology Student Re;»ctionnaire Form E 



The title of this course is 
It is- offered at 



Name of your school 

Check the activities required of you in this course. Then estimate the 
approximate percentage of ^our time spent in each of the required activities. 
Some of the activities may not apply to your course. If that is the case, 
DO NOT CHECK those activities. Check only the activities which are provided 
for you in this course. If some of the activities provided are not in 
the list, add them in the space(s) provided. 

ACTIVITY APPROXIMATE PERCENT 

OF MY TIME SPENT IN 
EACH CHECKED ACTIVITY 



□ Group lectures 

Discussion groups 
Q Individual, tutoring 
Q Reading (books, articles, etc.) 
r| Laboratory activity 

Field work activity 

t3 Programmed instruction (audio-tutorial or 
other look" listen-read- respond methods) 

Q Moving pictures and/or television 

Demonstrations 
[ I Writing (term papers, projects, etc.) 

Other (please specify) 

D 

□ 

D 

TOTAL 

Must add to 100% 
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Below arc statements of opinion about this course. You may agree or disagree 
with each statement in varying degrees. For each statement, place an "X^' in the 
coluwin which host expresses the strength of your agreement or disagreement. Please 
answer every item with a single "X". You may use the hack of the form to express 
any other ideas or feelings you have about the course. 



STATEMENT 


strongly 
Agree 


Agree 


Neutral 


Disagree 


^ o 

k \A 
0 Q 


1. This course requires too much busy work. 












2. I always know what is expected of me in this course. 












3. This course is very interesting. 












4» I wish all my courses were taught this way. 












5. I hope I never have to take another Biology course 












6. I've learned more than I expected I would in this course. 












7. I get the individual help I feel I need in this course. 












8. I intend to take another Biology course sometime. 












9. This course is too structured. 












10. This course ranks among the best I have ever taken* 












11. I wish the course provided more guidance* 












12. I would describe this course as "learning by doing." 












13. I would prefer more lectures. 












14. I wish more time were given for special projects. 












IS. I would like more individual attention* 
O : 
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APPENDIX B 



GWC-UCl TWO-SUMHER INSTITUTE FOR BIOLOGY TEACHERS 
STATEMENT OF INSTITUTIONAL RECOKMENDATION AND SUPPORT 



It is a goal of this institute that participants will return to their home 
institutions as effective change agents, stimulating the use of educational tech- 
nology and systams approaches to teaching. The achievement of this goal depends 
heavily upon the recruitment of participants with a genuine interest, from institutions 
with a sincere cotnmltment. 



Please be frank. This report will be treated as strictly confidential* Please feel 
free to add additional sheets as necessary I 
NAME OF APPLICANT: 



Years of teaching the biological sciences at your institution: 

Please provide any information about this applicant which you feel helps to identify 
him as a potentially successful Innovator in his own courses, and as a change agent 
in his institution, Give examples of Innovative ideas of the applicant. 



Please identify any special characteristics (weaknesses or strengths) about which we 
should know in order to work most effectively with this participant, 



Please identify here what the Institution Is willing and able to provide the participant 
toward Innovational efforts, (Paraprofesslonals, released time, flexible schedules of 
labs* lectures, or demonstrations, Instructional materials, audlo-vlsuals, etc) 



Please Mall To: ~ 

YOUR NAME 

Mr. Hayden R, Williams, Co-director 

POSITION UCI-GWC, NSF Biology Summer Institute 

Golden West College 

INSTITUTION 15744 Golden West Street 

Huntington Beach, California 92647 
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AUniOR; lican, '-arl D. 

SacraMunio City College 
Sacrainonto, California 

TITLE: SOLUI'ION CiinM 5 BIO-PHYSICO-CHliMICO CII/vR/^CTERISTICS OF CELL 
TRANSI^ORT 

TARGET: UndcrEraduatc Pre-Professional 

CONTENT: The Cell membrane, types of solutions, methods of expression, 
concentration ^wi th problems, includes molar, normal, acid and 
base and how to determine the percent; diffusion, cell membrane 
permeability constants, mediated transport systems, (active 
transport etc.) the carrier hypothesis and osmosis. 

FORMAT: Objectives, post test, script wliich includes instructive 

paragraphs followed by problems and some fill in questions, 
witl\ specific reference to diagrams and a slide set. 



AUTHOR: Burling, Edwin 
De Anza College 
Cupertino, California 

TITLE: PROTEIN SYNTHESIS 

TARGET: Majors 

CONTENT: Tlie student through questions and answers is guided through the 
process of protein synthesis, DNA, RNA, structure and functf :r\ 
are also discussed. Through use of printed models the student 
constructs a protein. 

FORMAT: Written script for student; molecular models printed on cards. 

Programmed approach includes objectives, questions and discussions, 
followed by short self tests. 



AUTHOR: 

TITLE: 
TARGET r 
CONTENT: 



HORM/vT: 
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Dominguez, Gilbert M, 
San Antonio 
Walnut, California 

THE ORIGIN OF LIFE ! 
Non-Majors (Introductory Biology) 

Special Creation Theory, Cosmozoa Theory, Spontaneous generation, 
Organic compounds from inorganic substances; Origin of a Cell; 
Heterotroph n>'pothesis. The exercises pertaining to these topics 
are well supplemented with diagrams, charts and explanatory para- 
graphs. Most of the practice questions arc fill-in or brief essay. 

Teacher's Guide includes instructions for labs and an audio-script, 
a post test which consists of 59 multiple choice questions. Students 
Guide includes objectives, diagrams with related questions; and a 
bibliography. 



AUTHOR: Gulhvaith, Robert T. 

San iksrnardino Valley College 
San Bernardino, California 

TITLE: BNliKGY AND Lim: POOD TYRy^vMlD I 5 11: POOD CHAINS AND WHBS 
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TARGl'T: Non- Majors 

CONIBNT: MuscJe function; energy, its importance to the body> calorics, 
characteristics of living organisms^ entropy, food pyramids and 
food chains. 

PORMAT: All four packets include a list of objectives, discussion 

paragraphs and diagrams followed by fill-in questions; a post 

test with fill-in questions similar to those used in the discussion. 



AUTHOR: Gilbertson, Lance 
TITLE: THE METRIC SYSTEM 
TARGET: Non-Majors 

CONTENT: PacKot aims at making the student proficient with tools of 
measurement, specifically the metric ruler, a triple-beam 
balance, a centigrade thermometer, and a graduated cylinder. 
The student also learns to do metric conversions. 

FORMAT: Five objectives, the packet discusses each objective in detail 

and gives the student many practice problems. A post test where 
the student must demonstrate that they can weigh and convert the 
data accurately. 



AITTHOR: Green, Peter 

TITLE: ECOLOGY: POUR MINI PACKS 

1 . Ecosystem 

2. Populations and Communities 

3. Terrestrial Ecosystems 

4. Fresh Water and Marine Ecosystems 



TARGET: Non-Majors 

CONTENT: The program uses many different media. Mini pack # 2 utilizes 
the computer to determine population stresses, air and land 
polution^ population problems. Mini-pack # 3 utilizes many 
slides about the different ecosystems in the area. 
All the packs are intergrated with the text F undamental 
Concepts of Biology by Boolootian, et al, (2rid edition). 

FORMAT: Audio-script, objectives, slides, diagrams, student lab manual 

which contains many fill in questions that the student must answer 
while working with the tape, films, coir^putcr problems with prcdritor- 
prey and population growth rates. Designed to take approximately 
4 weeks* 



ERLC 



63 



AUTIIOK: Griffin, Robert 

TITLH: CLASSICAL GL'NUTICS PART I, TIIU WORK OF MENDEL 
TAUGHT: Non-Majors 

COMTI:NT: Principal concepts developed by Mendel, principles of scientific 
exporijr.entation and hypothesis fonnation as exemplified by 
Mendel's experiments* 

FORMAT: A script intended for use cither as a script for an audio tape 

or as a printed text; a sot of illustrations which can be provided 
for the student either in booklet form or as slides; a student 
response booklet; objectives; 40 true-false question post test. 



AUTHOR: Guinasso, Kenneth 
Laney College 
Oakland^ California 

TITLE: ECOLOGY (A SUB-SECTION OM BIOMES) 

TARGET: Majors and non-majors 

CONTENT: Discussion of major biomes, their physical characteristics; plants 
and animals of major biomes; man's influence; inter-relationships 
of organisms in each of the major biomes; adaptations of the biomes. 

FORMAT: Short paragraphs with specific references to slides and maps; 

followed by short fill-in questions and then a discussion of the 
correct and incorrect answers. 



AUTHOR: Hansen, Paul 

TITLE: THE CELL STRUaURAL BASIS OF LIFE 
TARGET: Non-Majors 



CONTENT: Historica 



on 



ni^Lunv^al background of the microscope and the cell theory; 
differences between plant and animal cells; detailed discussi 
of cell structure, function, and location of structures . 

FORMAT: TEACHER'S GUIDE: Includes basic assumptions, i.e*, background 

information about student knowledge; list of equipment needed for 
packet, outline of topics; and objectives. 

STUDENT SECTION: Outline, pre-test, a student lab manual with 
many diagrams of plant and animal cells with related questions; 
a post test and an audio-script. 
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AUTHOR: llavkiri, Arthur (Paul) 
Footbill College 
Los Altos Hills,, California 

TITLE: BASIC BODY REGIONS AND TEfWS OF ANATOMICAL REFRWiKCE 

TARGET: Anatomy students (first semester) 

CONTENT: Petite Pack 8 is a casual but thorough approach to the organi- 
zation of the skull. There is a step by step discussion of all 
the skeletal bones with reference to a skull that each student 
has checked out from the instructor. The packet uses ^'Textbook 
of Anatomy ^ Physiology'^ by Anthony as a reference throughout. 

FORMAT: Cassette tapes, film strip, objectives, descriptive paragraphs of 
the skull structure followed by questions. Post test with many 
imaginative essay and filUin questions. 



AUTHOR: Kildebeck, Jack 

Bakersfield College 
Baker sfield, California 

TITLE: CLASSICAL GENETICS 

TARGET: Non-Majors ' ' ^ . . 

CONTENT: Packet discusses the following topics; sex- linked, chromosome 
crossing over, sex influenced, genes which lack dominance, 
genotype and phcnotype in Fj and F^ generations, multiple genes 
and multiple alleles, blood group genotypes and phenotypes, 
non-disjunction, deletion and translocation of chromosomes with 
pictures and discussion of Klinefelters Syndrome, Trisomy 21, 
Trisomy X, and turner's Syndrome, 

FOR>iAT: Objectives, discussion, numerous diagrams, essay post-test; 
four separate packages each with the same format. 
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AinilOR: Moore, Georp,o L, 

Ajiicrican River Collc^;e 
Sacrau..cnto , Cal i f orni a 



TITLE: 



THE CELL 



TARGET: ^fajors 

CONTENT: Packet consists of essentially three topics 1) history of the 
microscope; 2) Cell theory. Cell Structure and function; 
3) Spectrophotometer, Principles, Applications and Use, Packet 
# 3 teaches the student the proper use of a Spectronic 20 and 
how to calculate the data gathered • Packet 2 is a detailed 
discussion with diagrams of plant and aniinal ultrastructure* 

FORMAT: The packet is introduced with a flow chart, followed by a list 

of necessary materials for lecture and labs; objectives relating 
to films being used, to organelles in living plant cells and the 
electron microscope. Script for week one, post test with a few 
matching, essay, fill-in, but mostly multiple choice questions. 
Student Packet includes: flow cliart, objectives, reading 
assignments, bibliography, lab. exercises, index to 35 mm 
slides that are used. 



AUTHOR: 



TITLE: 



Newkirk, Gail 
Antelope Valey College 
Lancaster, California 

BASIC CHEMICAL AND PHYSICAL PROCESSES OF LIVING THINGS: FOUR 
MASTERY UNITS Also includes an introductory packet titled: YOUR 
GUIDE TO SUCCESS IN BIOLOGY 



TARGET: Introductory Biology Students 

CONTENT: Mastery Unit I: Introduction to Basic Chemistry, discussion of 
condensation theory of solar system formation; earth's age and 
physical conditions; formation of the first life compounds. The 
•audio-script includes discussion, diagrams and questions which are 
integrated with the tape. 

^Mastery Unit 2: Discussions and questions related to electrical 
charge, atom structure, forms of energy, electron transfer. 
Mastery Unit 3: How to read a Periodic Table; chemical reactions; 
valences, and bonding. 

Masteiy Unit 4: Empirical and Structural Formation, Balance 
Equations; Hydrophobic Interaction; Van der Waal bond; and 
equilibrium. 

A Detailed Guide to Success in Biology could bo used by any biology 
Instructor as a preface to any course* 

FORMAT: Includes an audio script for the student, a narrative for the 
instructor, illustrations (suggests a set of plates for each 
student). Criterion Exam for Learning Packet I contains 20 
multiple choice, 20 fill-in questions and four brief essay 
questions. 
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AUrnOR: Paige, Charles D. 

Cevritos College 
Norwalk, California 

TITL!:: ECOLOGY WITH FOUR SUBTOPICS: 

I. Variations and Adaptation 
11 ♦ Physical Factors of the Environment Part I 5 11 
111. Biotic Factors of the Enviionment 

TARGET: All students 

CONTENT: I. Variations and adaptations; balance of an organism with its 
changing environment. 

II. Physical Factors of the Environment Part I discusses the 
terms biotic and abiotic, discusses aquatic and terrestrial 
environments, gives a definition of medium, substrata and inorganic 
nutrients. ' 

III. Physical Factors of the Environment Part II discusses 
a) water adaptations; b) Influence of temperature and other 
environmental conditions; c) adaptations of warm blooded animals; 
d) plant adaptations to light. 

IV. Biotic Factors of the Environment: a) niches; b) predation; 
c) biotic environment vs abiotic; d) K^ttlcwell's Study on 
Adaptations. 

FORMAT: All four packets follow the same format: Objectives, vocabulary 
words, a student worksheet, materials list and discussion. A 
pre-test is being prepared, the post test consists of the objectives 
attached to each of the parts. 



AUTHOR: Pedorson, Lloyd 

San Joaquin Delta College 
Stockton, California 

TITLE: CHARACTERISTICS OF LIVE, LOCOMOTOR STRUCTURE OF MICROORGANISMS 
TARGET: Majors and non-majors 

CONTENT: Characteristics of Life: Discussion of movement, metabolism, 
reproduction, growth and adaptation using a Parainecium as an 
^example. The discussion is ended by a very intriguing question 
to test the student. Locomotor Structure of Microorganisms: 
Identification of cilia, flagella, pseudopodia, their structure 
and function, muscular contraction. Packet also includes a 
brief review of the microscope, using the Paramecium for live 
material* Uses film loops of Ameba and Planar ia to demonstrate 
their mobility. 

FORMAT: Both packets contain a list of objectives, a script, and a post- 
test* 
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TITLE: 

TARGET: 
CONTHKT: 



1*1 ice, George 
Harbor College 
Wilmineton, Californio 

I, AN INTRODUCTION TO ECOLOGY: 



II. TIE liCOSYSTEM. 



sub-topics, Characteristics of 
hxSo, The Coiumunity, Habitat, 



All students 



Definition of an ecosystem and description of various kinds; 
relationship of plants and animals to orv ecosystem, food chain, 
its importance to an ecosystem. An Introduction to Ecology 
introduces the student to ecological terminology. 

FORMAT: Introduction, objectives, discussion and questions^ post-test. 



AUTHOR: 

TITLE: 

TARGET: 

CONTENT: 



FORMAT: 



Resales, Anthony J. 
Consumes River College 
Sacramento, California 

OBSERVING 6 MEASURING PROGRAM I 

Beginning chemistry students, and stockroom assistants. 

Instructions for students in collecting data, methods of organizing 
data* Methods of measuring with a pipete, a ruler, a top loading 
balance and/or a triple beam balance. Calculation of density; a 
well organized approach to the tedious task of teaching students 
how to weigh accurately . 

A step by step (hand-holding) discussion of methods of observation; 
post test, an audio-script and student work sheets. An easy 
reading and interesting approach to the correct methods of analysis. 



AUTHOR: Rulon, Charles 

Long Beach City College 
Long Beach, California 



TITLE: 



GROin'H OF HUMAN POPULATION 



TARGET: Anyone who can read and has been through 8th grade math. 

* CONTENT: The intent of this packet is to instruct student on how to calculate 
birth, death and migration rates. It shows students how to 
interpret their data by use of graphs. It^s main aim is to shock 
the student into concern about population. 

FORMAT: Objectives, discussion and questions, a check list for each of 

the 19 objectives, a supplement packet that includes quest iouaircs , 
reference books and data sheets. 
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AUTHOR: Schno^bcck, CharJes 

TITLE: ARGUMENT, /WRJGUITY AND l:Xri:llIMENT. 

TARGET: Non-majors 

CONTENT: Development, parts of an argument and practice writing each; 
the role of each, all this leads to the student performing an 
experiment to determine an oxygen source for fish sealed in a 
plastic bag. 

FORMAT: Introduction, objectives, series of practice frames, and discussion, 
and a post test. 



AUTHOR: Siegcl, Monica E. 

Palo Verde College 
Blythe, California 

TITLE: TAXONOMY OF FLOWERING PLANTS: Sub Titles: The Parts of the Plant 

The Parts of the Flower 
The Indented Key 

TARGET: Students, adults, elementary teachers with a basic knowledge of 
botany. 

CONTENT: By using Desert Mallow as a reference leaf* the student is guided 
through the proper use of a dichotomous key. The student is then 
tested with an unknown leaf. The other two packets discuss as 
their titles imply, the major parts of flowers and plants by using 
very detailed diagrams and slides of each. 

FORMAT: Each packet includes: Objectives, a post test, diagrams, discussion 
of plant and flower parts, and a self-test. 



ALTTHOR: Thorpe, Darwin 
Compton College 
Compton, California 

TITLE: HUMAN POPULATION AND THE STANDARD OF LIVING: IN TWO PARTS 

TARGET: Any college undergraduate or graduate student. 



CONTENT; 



FORMAT: 



ERIC 



Quotes from Paul Ehrlich on air pollution and a brief discussion 
of each. Questions to make the student wonder what over population 
means, and what conditions in our environment are the direct or 
indirect result of over population. (e.g» recreational areas, lack 
of jobs, air pollution) The first packagers aim is to help the 
student establish where he is in the stratum with respect to job 
and recreational satisfaction. The second package is concerned 
with relating all national strata to the individual by using the 
Allen formula. 

Packet 9 1 includes objectives for both packs. Program is a scries 
of paragraphs, newspaper clippings and problems relating to each* 
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AOTHOR: Verity, Sucbclle 

Los Angeles Southwest College 
Los Angeles, California 

TITLB: PARTS OF TUB MICROSCOPE, A MINI PACKAGE 
THIi METRIC SYSTEM, A MINI PACKAGE 

TARGET: Non-Majors 

CONTENT: The Metric System, a rnni package is broken into four parts: 

1) linear measures; 11) weight; III) volume; IV) temperature. 

Each of these follows a format of ^'programmed" questions. 

The student is asked to jneasure something and then to perform metric 

conversion. The prograni includes the answers with it'l 

The microscope- -a mini package follows the same format where 

through numerous questions and reference to the diagrams of a 

microscope^ the student should be able to learn all the parts and 

functions . 

FORMAT: Each mini package is broken into mini objectives, discussion, 

diagrams with related brief essay questions, post test with specific 
instructions for instructor or course assistant, a script which 
calls for the use of a 35mm film strip* The mini-package, the 
Metric System includes a pre test where the students must demonstrate 
that they can do metric conversions. 



AUTHOR: Walston, Wilbur L, 
Cypress College 
Cypress, California 

TITLE: DNA, RNA, ENZYME STRUCTURE AND FUNCTION 

TARGET: Majors 

CONTENT: The packet discusses the term zygote, the function and structure 
of DNA, ribosomes, enzymes, RNA their functions and locations in 
the cell, codons and anti-codons and a brief discussion about 
vitamins and how some act as coenzymes. The packet assumes that the 
student is already familiar with many biological terms. 

FORMAT: Objectives, diagrams, discussion with brief essay questions 

related to discussion paragraphs, A multiple choice post test. 
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AUTHOR: 



Wright, Dnvid M, 
Portcrvilie College 
Portcrvillc, California 



TITLE: 



TERMS OF RnPORnNCK IN ANATOMY 



TARGET: Sophomore paramedical majors 



CONTENT: 



FORMAT: 



By using diagrams and many questions the packet familiarizes 
the student with the anatomical terms of position, movement, 
(abduction, adduction) direction and plane. Could definatcly 
be used in an Introductory Anatomy class or serve as a review 
for anyone in ?nedical, nursing or related professions. 

The packet is a supplement for the lab manual (A Laboratory 
Manual of Mammalian Anatomy and Physiology, by GroUman) 
includes a study guide, a script, a post test and objectives. 
The student guide includes many fill-in practice questions. 



AUTHOR: Yale, Thomas 

Bakcrsficld College 
Bakersfield, California 

TITLE: DNA § PROTEIN SYSNTHESIS IN FOUR MINI-PACKS 

TARGET: Majors 

CONTENT: The four mini packs are concerned with the following topics: 

1. The gene as it relates to proteins, the chemical basis of 
the gene, the structure of DNA. 
II* Duplication of DNA, DNA as the protein code 
HI. The need for Intermediate Compounds for Protein Synthesis, 

the synthesis of RNA. 
IV. The t>T)es of RNA (survey), the Reading of the DNA code, 
Messenger RNA, transfer RNA and protein synthesis. 



FORMAT: 



Each minipack includes: Objectives, script, post test. The 
script is for the student. It has practice exercises integrated 
in it. The answers for the practice exercises are on a separate 
sheet at the end of the packet. 
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APPENDIX D 

Evaluation of Adaptive-Flexibility Protocola 
Of Cooperative Science Improvement Project Participants 
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EVALUmON 01' ADAPriVB-PLEXIBlLITV PROTOCOLS OP COOPERATIVE 

SCIKNCii IMPROVEMKNT PKOJECT PARTICIPANTS 
Florence B. Brawer 

The Adaptive-Flexibility Inventory, a word-association technique 
designed to asseae ego functioning in the ''norraal" adults purports to 
measure specific demcnsicns of this core concept: reboundabilityi tolera- 
tion of arabiguity, intelligencei reality testing, both primary and 
secondary process associations, and the ability to ^'regress in the service 
of the ego*^ 

It consists of 180 stimulus words to which the respondent reacts 
by writing his immediate responses* It is self-administering and takes 
approximately 20 minutes to complete* The A-P Inventory has been used 
with various groups of people: Undergraduate and graduate students, 
teaching interns, participants in encounter groups^ and adults functioning 
in various professional fields. Interscoror reliability appears to be 
high with trained interpreters and positive concurrent validity has been 
established with A-F ratings and five approaches to Rorschach interprets- 
cion« In previous studies, Pearson r correlations were found to be 
significant (.05 level) for A-F ratings of beginning instructors and in- 
dependent judges-*i#e., Junior college instructor supervisors* (Brawer 6c 
Cohen, 1966; Cohen & Braver, 19&7)# 

The A-F Inventory is scored according to a 7-point global rating 

which considers all associations to the stimulus wordai 

To understand the cneartinfi of the global assessment 
of ego stren»;th on thc' 7-point scale, two points; need 
special ewpha>is: (I) ego strength, like other psy- 
chological coniitructs, cannot be directly measured, 
and (2) in tno absence of any direct means for mea- 
suring this core ;>ersonallty dimension, any Indirect 
measures cannot bo completely objective. With the 
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A P ocnlc, no with other p^ycholofjlcnl tools , 
ii)uch dopcndb upon the interprcLer > the kind 
of trnininc he hos had, and upon hio ability 
to translate that training into practice. Much 
also depends upon the scorer-interpreter's 
understanding of individual dynamics, awareness 
of his own personalityi his biases, and his 
' particular focus of interests. Flexibility 
for one person night be considered a source' 
of strength while for another, intellectual 
prowess is the key feature* (Brawer, 1967) 

Tentative percentages have been postulated for the "normal" adult 
population, with 5% of the population assumed to achieve ratings of I and 
7; 10% achieving ratings of 2 and 6; ISVmS; 20%,3; and 35% of the adults 
throughout the nation falling into the 4th category* 

Subjects receiving one of the 7 possible ratings may be briefly 
described as follows: 

2 * ^ person receiving this rating is seen as possessing an ex- 
tremely high level of ego strength/ He is creative and flexible; 
tolerates ambiguity; is able to offer intelligent, reality 
oriented responses and also, to regress when desired«-using 
primary process acsociatiots which, in this context, suggest 
strength rather than weakness « 
6 This subject offers responses which are primarily reality- 
oriented and intelligent but not especially flexible or creative* 
Certain negative signs (e.g., perseverations, stress on complex 
areas, signs of suppression or repression, and an overly per- 
sonal emphasis) may be present. In general, however, this 
person is independent, intelligent, and rcality^orlented. 
^ - A subject attaining a '^S" rating is considered to be function- 
ing at the top of the average group* He is fairly intelligent 
and, althougl^ soniewhat constricted, steady rather than croatlvo 

Rir ' 



or flexible • 

A - The "4" is usually accustomed to doing the right thing at the 
expected time* His responses arc rather tnatter-of-fact and in- 
dicate average intelligence ^ with few emotional problems* At 
the same timci he tends to be banal « 

3 - Word associations of the "3^* respondent indicate dependence on 
defense mechanisms, intmaturity, and constriction ♦ This person 
has a tendency to be Judgmental and reactive rather than open 
and independent* 

2 - A rating of "2" suggests low ego functioningi either because 
of belov-*avorage intellectual ability or a preponderance of 
emotional problecos* This respondent tends to be dependenti 
rigid » stimulus-bound I impulsive and| occasionally, not oriented 
toward reality* Repression and suppression are commonly used 
defense mechanisms* 
1. - This subject is either overtly psychotic or so severely dis- 
turbed that he is hardly ablo to function in a '^normal" society* 
The ••r* who is able to respond to the A*»F Inventory offers a 
preponderence of negative associations. His cues come almost 
solely from within and are unrelated to external reality* 
Th e Cooperative Science Improvement Project 

A"P protocols were administered to participants of the Science 
Improvement Project at the end of their workshop. All of these people 
were biology teachers in California Junior colleges who were sufficiently 
interest.ed In improving their own teaching to participate in the project* 
Two of these people declined to respond and 2 of the original 27 were 
absents Tout;, 23 protocols were completed* Tiiese were scored and ^^^^^^^ ^^ ^ 



intcrpvctcd by the inotrument 's author according to directions for the 
A-r Global Ratine Ii^ addition, for purposes of this project, a second 
rating was assigned each subject**-the Implen\entatton Score. This was 
based on the interpreter's Impressions regarding each subject's tendencies 
to implement the concepts he learned--i«e« , his inclination to prepare 
self-instructional packages for his students, write objectives, and build 
audio- tutorial laboratories in biology* 

While the Global Rating applies to the individual in any setting, 
the accuracy of the Implementation Rating is directly tied to the teaching 
situation in which the subject functions. In practice, the amount of 
support the participants will receive for these activities will vary* 
Some presidents, deans, chairmen will go all out to aid in getting the 
labs built* Others will remain neutral* Xn some cases colleagues will 
be supportive; in most, however, they will be non-committal ("Well, if 
that's what he wants to do, I'll watch and see") or possibly antagonistic 
("You build these devices for your students if you want but don't expect 
me to even visit the lab or take any part")* Accordingly, it is difficult 
to predict who will build his AT lab or prepare, administer, revise, and 
manage any forms of self-instructional material* A lot depends on the 
environment the Instructor finds at his home campus, the amount of 
positive pressure his supervisors apply, and/or the negative reactions 
of his peers* 

Assuming, however, that most Instructors will find an open cllmatc-- 
i*e*, "Do what you want, we'll help where we can'*«-combincd with the in- 
stitutional syndrome which holds that one instructor must not go too fast 
lest he engender peer disapproval. Jealousy, and concoiDltant antagonism^ 
' Cne participant who does pursue self«in$tructlon devices must be: 



aclf-ausuved 

coiwlnccd of the worth of A-T in causing otudcnt learning 
dedicated to causing student Irirning (as opposed to 

sorting and punishing) 
tenacious 

willing to work beyond the damand of his Job but realising 
that he retains his position even if he does not pursue 
vorkshop-type aims 

Integrated and self-directed 

Independent of the need of applause from students for his 

personal attributes 
not a "mediator'* (Cohen and Braver, 1972) 
flexible 

Given these conditions and these people, a S-^point system was 
devised, A through E, to assess Implementation tendencies* Subjects 
scoring A are seen as people who will do what they want » overriding any 
obstacles that may be encountered* "B; subjects will try to implement 
the workshop's concepts and methods but will need some encouragement frotA 
the setting. "C's" will do so only with a considerable amount of support 
while *'D's" may try for a month or so and then give up unless pushed to 
continue. "E's" are conceived to be individuals who participated in the 
workshop only under specific direction and who will implement suggestions 
methods, etc. only if considerable pressure is exerted on them to do so. 
Results 

The A'-P Global Score and the Implementation Ratings for the 23 
subjects comprising this group are presented in Table I« 



Note thai: each person is given a nunvcricAl score but that not every one 
of the possible ratings has been utilizedi as shown in Table 2*6 dis- 
tribution of ratings* 

iTable 2 horcj 

Table 3 shows the distribution of the Implementation Rating for 
this group; again^ note the absence of the two lowest ratings* 

Table 3 here 

Table 4 presents the association between A'-P and Implementation 
Ratings* 

Table 4 here 

It Is evident that although high A-F scorers usually tend to attain high 
Implementation scores ^ this does not always pertain* Sometimes a high 
scorer on the A-P appears to be more intelligent and "steady'' than 
creative and flexible; yet, a certain degree of flexibility is required 
for implementing changed procedures. In the interest of not wanting to 
"rock the boat/' he may not be as willing to introduce and carry through 
innovative procedures. And finally, Table 5 presents the association of 
ages with both A-F and Implementation ratings* 

ITable 5 here 

Statistically a test was made of the hypothesis that the two rating 
methods are independent. The Pearson correlation coefficient was computed 
to be 0.8578 and is significant at the 0*0005 level for a sample of size 
N«23* In addition two Chi*Square tests were made to determine if there 
is a difference in rating patterns of teachers divided on age. The 
sample was stratified into two age groups: those teachers 38 and older 
and those teachers 37 or younger. The statistic for the A rating 
schcine wris 2.0192 while thva for the Tmj>li'fun\tat ion rating vac 0.0728* 
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Both values arc not significant. 
piscu£?ston 

Although the A^P scale Is a fairly new research tnstrurrtcnti some 
reliability and validity have been established* It appears to be parti- 
cularly useful with adults functioning In a professional setting* The 
ItQpletnentation score was devised just for these 23 protocols. It is 
suggested that a follow up assessment be nade with the 23 subjects 
responding to the A-f*> a few mont-hs after they have returned to work. 
Have they, indeed » itaplemented the working procedure? Do high A"P scores 
and high Implementation scores actually relate to tendencies to establish 
changed procedures? 
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A-F Global Ratings, Implementattoti Ratinf>3 and Anticipations of Cooperative 
Science Improvement Project Participants 
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TABLE 2 

Distribution of A-F Ratings Among WorVshop Participants 
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TAULE 4 



ComparlBons of A-F arid Implementation Ratings 
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